# Autoregressive Language Model

A Korean-English bilingual autoregressive language model based on LLaMA2-13B architecture, focusing on Korean corpus learning while retaining English capabilities

MoLM is a series of language models based on the Mixture of Experts (MoE) architecture. The 700M-4B version has a total of 4 billion parameters, with computational consumption equivalent to a dense model of 700 million parameters.

Polyglot-Ko-5.8B is a large-scale Korean autoregressive language model developed by EleutherAI's multilingual team, with 5.8 billion parameters trained on 863GB of Korean data.

A sci-fi/fantasy-themed language model fine-tuned based on GPT-Neo 2.7B

A sci-fi themed language model fine-tuned from GPT-Neo 2.7B, excels in generating science fiction texts